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Claims 



We claim: 

1 LA method for temporally processing an input video including a plurality 

2 of input frames, each of the input frames having an associated input frame 

3 play time, and the input video having a total input video play time that is a 

4 sum of the input frame play times of all of the input frames, comprising: 

5 classifying each of the plurality of input frames according to a content 

6 characteristic of each of the input frames; and 

7 allocating an output frame play time to each of the plurality of input 

8 frames that is based on the classified content characteristic of each of the 

9 input frames to generate a plurality of output frames. 

1 2. The method of claim 1 wherein the content characteristic is based on low- 

2 level features of each of the input frames. 

1 3. The method of claim 1 wherein the low-level features are selected from a 

2 group consisting of motion vectors, color, texture, brightness, contrast, 

3 spectral parameters, local and global motion, activity, trajectory, speed, 

4 acceleration, object shape, object size, number of objects, number of faces, 

5 pitch, volume, tempo, and combinations thereof. 

1 4. The method of claim 1 wherein the content characteristic is based on 

2 high-level features of each of the input frames. 
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1 5. The method of claim 1 wherein the high-level features are selected from a 

2 group consisting of genre, dramatic intensity, humor content, action level, 

3 beauty, lyricism, musical intensity, educational quality, profundity, nudity, 

4 linguistic class, and combinations thereof. 

1 6. The method of claim 1 wherein the allocating of the play time is 

2 dynamically varied while processing the video. 

1 7. The method of claim 1 wherein the allocated output frame play time of 

p% 2 each of the output frames is determined by sampling the input frames. 

1 8. The method of claim 7 wherein the sampling is a down-sampling of the 

2 input frames. 

1 9. The method of claim 7 wherein the sampling is an up-sampling of the 

t": 2 input frames. 

6 

1 10. The method of claim 9 wherein up-sampled output frames are 

2 interpolated from the input frames. 

1 11. The method of claim 7 wherein the sampling is a combination of down- 

2 sampling and up-sampling of the input frames. 

1 12. The method of claim 1 wherein the allocated output frame play time of 

2 each of the output frames is determined by an output frame rate of the output 

3 frame. 
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1 13. The method of claim 12 wherein the output frame rate is increased for 

2 selected input frames. 

1 14. The method of claim 12 wherein the output frame rate is decreased for 

2 selected input frames. 

1 15. The method of claim 1 further comprising: 

2 measuring the content characteristics of each of the plurality of input 

3 frames to determine the classification. 

1 16. The method of claim 15 further comprising: 

2 computing a statistical moment for the measured characteristics to 

3 determine the classification. 

1 17. The method of claim 1 wherein the allocation of play time is based on a 

2 constant level of motion activity in the output video. 

1 18. The method of claim 1 wherein the allocation of play time is based on a 

2 guaranteed minimum level of activity in the output video. 

1 19. The method of claim 1 further comprising: 

2 partitioning the input video into a plurality of segments, and 

3 processing the input video on a per segment basis. 
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1 20. The method of claim 1 wherein still frames are selected for the output 

2 video when the allocated output frame play time exceeds a temporal Nyquist 

3 limit. 

1 21. The method of claim 1 further comprising: 



4 frame play times of the plurality of output frames is equal to the total output 

5 video play time of the output video. 

1 22. The method of claim 1 wherein the allocated play time of a particular 

2 frame can range on a continuum from zero time to a length of time of the 

3 output video. 

1 23. The method of claim 1 wherein the allocation of play time is based on a 

2 motion activity in the output video, and a measure of motion activity is an 

3 average of magnitudes of motion vectors of the frames. 

1 24. The method of claim 23 where the average motion vector magnitude F of 

2 the input video of frames is expressed as: 



4 where an average motion vector magnitude of frame / is r,. 

1 25. The method of claim 24 wherein a relationship between a length Loutput of 

2 the output video and a length unput of the input video is expressed as 



2 



allocating a total output video play time; and 

allocating the output frame play times so that a sum of the output 
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^output ^input 
^target 



4 for a target level of motion activity target the output video. 

1 26, The method of claim 25 further comprising: 

2 classifying all of frames j of the input video having the motion activity 

3 equal to or higher than a targeted level of minimum motion activity into a 

4 first set Shigher having a length Lhigher\ 

5 classifying all of frames k of the input video having the motion 

6 activity lower than the targeted level of minimum motion activity into a 

7 second Slower having a length Lio^en 

jf ) 8 summing Lhigher + Liower to determine a L,>,p„, of the input video to 

9 determine a length of the output video by 



III 

y| 10 4„,p„, 



lower 



Aow*r ^higher • 



1 27. A system for temporally processing an input video including a plurality 

2 of input frames, each of the input frames having an associated input frame 

3 play time, and the input video having a total input video play time that is a 

4 sum of the input frame play times of all of the input frames, comprising: 

5 means for classifying each of the plurality of input frames according 

6 to a content characteristic of each of the input frames; 

7 means for allocating a total output video play time; and 

8 means for allocating an output frame play time to each of the plurality 

9 of input frames that is based on the classified content characteristic of each 
10 of the input frames to generate a plurality of output frames so that a sum of 
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1 1 the output frame play times of the plurality of output frames is equal to the 

12 total output video play time of the output video. 
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